Skip to content

Enable execution on CircleCI for more notebooks#241

Merged
bsipocz merged 1 commit intoCaltech-IPAC:mainfrom
bsipocz:CI_enable_more_run_on_circleci
Mar 24, 2026
Merged

Enable execution on CircleCI for more notebooks#241
bsipocz merged 1 commit intoCaltech-IPAC:mainfrom
bsipocz:CI_enable_more_run_on_circleci

Conversation

@bsipocz
Copy link
Member

@bsipocz bsipocz commented Feb 5, 2026

This requires circleCI specific testing via an SSH session as well as disabling a lot of the test skip logic, leaving as draft while iterating on it.

This closes #209

@bsipocz bsipocz added infrastructure Infrastructure related issues/PRs. html rendering / skip testing Rendering related issues/PRs. Skips tests in PRs. labels Feb 5, 2026
@bsipocz
Copy link
Member Author

bsipocz commented Feb 6, 2026

I was playing some significant amount of time today to find a combination that passes. At some point the following seemed to be a good combo, with the cloud access intro one either added or not, but then I couldn't reproduce the passing status. Looking at the resource log it seems that there wasn't really proper garbage collection during the session as the restarts were not real restarts.
So, apparently one needs to do this with brand new sessions and that just makes the task even more tedious.

So, I could imagine a better solution would be to enable back everything, and we keep an eye out to the resource problem in individual PRs -- then it's more clear which ones are affected (as we only test the ones that have been changed).

tutorials/roman_simulations/roman_hlss_number_density
tutorials/openuniversesims/openuniverse2024_roman_simulated_timedomainsurvey
tutorials/cloud_access/cloud-access-intro
tutorials/cloud_access/euclid-cloud-access

@bsipocz bsipocz force-pushed the CI_enable_more_run_on_circleci branch from c8dbbc8 to ce3ff86 Compare February 6, 2026 22:48
@bsipocz bsipocz mentioned this pull request Feb 27, 2026
@bsipocz bsipocz force-pushed the CI_enable_more_run_on_circleci branch 4 times, most recently from 694ae4f to cbcffdb Compare March 24, 2026 00:49
@bsipocz bsipocz force-pushed the CI_enable_more_run_on_circleci branch from cbcffdb to 97aaac8 Compare March 24, 2026 02:02
@bsipocz bsipocz marked this pull request as ready for review March 24, 2026 02:03
@bsipocz
Copy link
Member Author

bsipocz commented Mar 24, 2026

I manually iterated over this one, and it looks like we can only remove one notebook from the ignore list for circleCI, all the rest is running into memory limit issues, so at the end of the day the --execute-parallel 1 doesn't really have any effect on this problem.

@bsipocz bsipocz merged commit e602104 into Caltech-IPAC:main Mar 24, 2026
4 checks passed
@bsipocz bsipocz deleted the CI_enable_more_run_on_circleci branch March 24, 2026 02:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

html rendering / skip testing Rendering related issues/PRs. Skips tests in PRs. infrastructure Infrastructure related issues/PRs.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add more notebooks to CircleCI execution

2 participants